CCOBRA Evaluation Results

Benchmark Information
Benchmarksinglechoice.json
Date2020-04-25 14:16
typeadaption
domainsspatial-relational
response_typessingle-choice
data.testRagni2018_carddir.csv
data.trainRagni2018_carddir.csv
data.train_person
corresponding_datatrue
Results
Prediction Accuracy
RandomModelTransitiveClosureNeuralDynamicArchitectureAutoMLLSTMRNNANNPRISMMLPMostFrequentAnswerVerbal Reasoning00.10.20.30.40.50.6
Accuracy of Model PredictionsPredictive Accuracy

Predictive accuracies of the benchmark models, i.e., the percentages of correct predictions.

Subject-Based Boxplots
RandomModelTransitiveClosureNeuralDynamicArchitectureAutoMLLSTMRNNANNPRISMMLPMostFrequentAnswerVerbal Reasoning00.20.40.60.8
RandomModelTransitiveClosureNeuralDynamicArchitectureAutoMLLSTMRNNANNPRISMMLPMostFrequentAnswerVerbal ReasoningSubject Performance BoxplotPredictive Accuracy0.546875Subj.ID: 10

This plot depicts boxplots for the models indicating individual subject performance. The data used for the plot are accuracies for individuals. Consequently, min and max refer to the accuracy of the worst and best matching subjects. The dots refer to the mean accuracies of individual participants.

Most-Frequent Answer Comparison

No data encodings available.